
1 



IMAGE-CAPTURING APPARATUS 



BACKGROUND OF THE TNVRNTTON 



Field of the Invention 

The present invention relates generally to an image-capturing apparatus, 
and more particularly to a portable image-capturing apparatus that is capable of 
capturing a three-dimensional image and a panoramic image. 

Descriptio n of Related Art 

There has been proposed a variety of apparatuses, which capture a three- 
dimensional image with two optical systems provided in one camera (Japanese 
Patent Provisional Publication Nos. 6-273172 and 8-317424). There has also 
been proposed a method for selectively capturing a three-dimensional image and 
a normal two-dimensional image with one camera (Japanese Patent Provisional 
Publication No. 8-317425). 

The above-mentioned conventional apparatuses require that two image- 
capturing optical systems should be loaded in the body of the camera, and thus, 
the camera is large as a whole. When capturing only a normal two-dimensional 
image, the camera is not portable and is difficult to handle. 

There has also been proposed an adapter that guides a right- eye image 
and a left-eye image into one optical path. This adapter, however, divides 
effective pixels of an imaging device into two areas, and it is therefore 
impossible to achieve satisfactory image quality. 
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SUMMARY OF THE TNVRNTTON 

In view of the foregoing, it is an object of the present invention to 
provide an image-capturing apparatus that is as portable as the conventional 
camera when capturing a normal two-dimensional image, and that is capable of 
capturing a three-dimensional image and a high-quality panoramic image as need 
arises. 

To achieve the above-mentioned object, the present invention is directed 
to an image-capturing apparatus, comprising: a first image-capturing unit having 
a first image-capturing optical system; and a second image-capturing unit having 
a second image-capturing optical system, the second image-capturing unit being 
detachably connected to the first image-capturing unit. 

According to the present invention, the second image-capturing unit is 
detachably connected to the first image-capturing unit, which functions as an 
image-capturing apparatus by itself. In the case of the normal image-capturing, 
the second image-capturing unit is detached from the first image-capturing unit, 
and only the first image-capturing unit is used. To capture the three- 
dimensional image and the panoramic image, the second image-capturing unit is 
connected to the first image-capturing unit to construct a multiple lens camera. 

As described above, the image-capturing units are modularized so as to 
freely switch the modes of the optical systems between a single lens mode and a 
multiple lens mode according to the purposes and conditions. The image- 
capturing apparatus is portable as the normal single lens camera, and it may also 
be used as the multi-lens camera by connecting the image-capturing units to 
increase the functions. This eliminates the waste in the structure of the image- 
capturing apparatus. 
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BRIE F DESCR I PTI O N OF THE DRAWINGS 

The nature of this invention, as well as other objects and advantages 
thereof, will be explained in the following with reference to the accompanying 
drawings, in which like reference characters designate the same or similar parts 
5 throughout the figures and wherein: 

Fig. 1 is a perspective view showing the structure of an image-capturing 
apparatus according to a preferred embodiment of the present invention; 

Fig. 2 is a perspective back view of the image-capturing apparatus in Fig. 

l; 

^10 Fig. 3 is a block diagram showing the structure of the image-capturing 

apparatus in Fig. 1; 

Fig. 4 is a perspective view showing another embodiment of the present 
invention; 

Fig. 5 is a perspective view showing an embodiment wherein three 
15 image-capturing units are connected; and 

Fig. 6 is a perspective view showing the state wherein an electronic flash 
unit is connected instead of the image-capturing unit. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

This invention will be described in further detail by way of example with 
20 reference to the accompanying drawings. 

Fig. 1 shows an image-capturing apparatus according to a preferred 
embodiment of the present invention. The image-capturing apparatus 10 
comprises a first image-capturing unit (a main camera) 12, which functions as a 
camera by itself; and a second image-capturing unit 14, which is capable of 
25 detach ably connecting to the first image-capturing unit 12. A taking lens 16, a 
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finder window 17 and an electronic flash 18 are provided at the front of a body 
of the first image-capturing unit 12. A shutter release button 20 is arranged at 
the top of the body. A charge coupled device (CCD) (not shown) is arranged 
behind the taking lens 16. Image light is formed on a light receiving surface of 
5 the CCD through the taking lens 16, and the CCD converts the image light into a 
signal electric charge corresponding to the quantity of the image light. The 
signal electric charge is read as an image signal in accordance with a drive pulse 
transmitted from a CCD drive circuit (not shown). The number of pixels in the 
CCD should be selected according to desired image quality, and the CCD 
OlO preferably has more than three hundred fifty thousand pixels. The imaging 
Q device is not restricted to the CCD, but it may be an imaging device such as a 
m metal oxide semiconductor (MOS) type imaging device and a charge injection 

SSi 

Jj device (CID). 

A slot 22 (equivalent to an information transmitting means and an 
m 15 information sending and receiving part) for receiving an external storage device 
^ 26 is formed at the right side of the first image-capturing unit 12 in Fig. 1. Two 

joint holes (equivalent to a connecting part) are formed vertically across the slot 
22, and the first image-capturing unit 12 is connected to the second image- 
capturing unit 14 through the joint holes 24. Examples of the external storage 
20 device 26 are a PC card, a smart medium (an image memory card), a flash 
memory card and an IC card. 

The second image-capturing unit 14 is provided with a taking lens 28, 
which is the same as the taking lens 16. As is the case with the first image- 
capturing unit 12, a CCD (not shown) is arranged behind the taking lens 28. A 
25 connector 30 (equivalent to the information transmitting means and a second 
information sending and receiving part) is provided at the left side of the second 
image-capturing unit 14, and two joints 32 (equivalent to a connecting means) 
are vertically arranged across the connector 30. The second image-capturing 
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unit 14 can be detachably connected to the first image-capturing unit 12 through 
the connector 30 and the joints 32. 

In the normal image-capturing, only the first image-capturing unit 12 is 
used as a single lens camera, and the external storage device 26 is attached to the 
slot 22. In a three-dimensional image-capturing or a panoramic image- 
capturing, the second image-capturing unit 14 is connected to the first image- 
capturing unit 12 to compose a multiple lens camera. More specifically, the 
joints 32 of the second image-capturing unit 14 are inserted into the joint holes 
24 of the first image-capturing unit 12, and the connector 30 of the second 
image-capturing unit 14 is connected to the slot 22 of the first image-capturing 
unit 12, so that the first image-capturing unit 12 and the second image-capturing 
unit 14 can connect, and the two image-capturing optical systems are 
horizontally arranged side by side. Signals and data are transmitted between 
both image-capturing units through the slot 22, which is originally capable of 
receiving the external storage device 26, and the connector 30. 

As is the case with the first image-capturing unit 12, a slot 34 (equivalent 
to a third information sending and receiving part) for receiving the external 
storage device 26 is provided at the right side of the second image-capturing unit 
14, and two joint holes 36 (equivalent to a second connecting parts) are formed 
across the slot 34. This enables the second image-capturing unit 14 to further 
be connected to another image-capturing unit, which has the same connecting 
structure as the connector 30 and the joints 32. Thus, a plurality of units can be 
connected sequentially. 

Fig. 2 is a back view of the first image-capturing unit 12 and the second 
image-capturing unit 14, which are connected to each other. A liquid crystal 
display (LCD) 40, a mode dial 42, a power switch 43, a finder eyepiece 44 are 
provided at the back of the first image-capturing unit 12. 

The LCD 40 displays an image captured through the image-capturing 
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optical systems, image information read from the external storage device 26 (not 
shown in Fig. 2), etc. For example, a 2-inch low temperature polysilicon LCD 
is used. Although not shown in detail, a parallax barrier display layer is formed 
on the surface of the LCD 40. In a stereo display mode, a parallax barrier is 
5 generated on the parallax barrier display layer, and the parallax barrier has a 
pattern in which light transmissible parts and light shielding parts are alternately 
arranged at predetermined pitches. Strip-shaped (narrow-rectangular) image 
fragments, which represent a plurality of images to be displayed, are alternately 
arranged and displayed on an image display surface under the parallax barrier 

10 display layer. If the image fragments represent a right-eye image and a left-eye 
image, a three-dimensional image can be displayed on the LCD 40. With this 
principle, an image can also be displayed so that it can look differently according 
to the viewing directions. For example, an image pattern is formed in such a 
way that image fragments A for the first display image, image fragments B for 

15 the second display image, and image fragments C for the third display image are 
arranged in order like A,B,C,A,B,C,A,B,C, .... 

The mode dial 42 is disposed at a position where the thumb of the hand 
holding the right part (a grip part) of the camera in Fig. 2 is naturally placed. 
The mode dial 42 is a control means for changing functions (modes) of the 

20 camera. For example, marks or characters indicating the following modes are 
formed at click stop positions along the circumference of the mode dial 42: 
"setup", "self-timer", "manual image-capturing", "automatic image-capturing", 
"reproduction", "erasure", "image protection" and "connection with personal 
computer". A mode is set by rotating the mode dial 42 clockwise or 

25 counterclockwise in Fig. 2 and setting the mark or the character indicating a 
desired mode to an index 46. 

A cross key 48 is provided at the back of the second image-capturing unit 
14. The cross key 48 is a control key, which is capable of tilting in four 
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perpendicular directions. A concave is formed at the center of the cross key 48, 
and four marks indicating the four perpendicular directions are formed on a slope 
from the edge to the central part. 

Pressing an area in proximity to one of the four marks tilts the cross key 
5 48 to thereby input the corresponding direction (upper, lower, right or left). The 
cross key 48 is a means for correcting discordance between the image captured 
by the image-capturing optical system of the first image-capturing unit 12 and 
the image captured by the image-capturing optical system of the second image- 
capturing unit 14. Operating the cross key 48 enters a direction and a 
q 10 displacement amount for finely adjusting the position and the angle of the image, 
'Q which is captured by the image-capturing optical system of the second image- 

I n capturing unit 14. 

jTJ Fig. 3 is a block diagram showing the structure of the image-capturing 

I™ apparatus according to the embodiment of the present invention. In Fig. 3, the 

■5 15 upper section is the first image-capturing unit 12, and the lower section is the 
*3 second image-capturing unit 14. The first image-capturing unit 12 comprises 

the taking lens 16, an imaging circuit 50, a lens drive unit 52, an automatic 
control data obtaining unit 53, a synchronous signal generating circuit 54, a 
memory 56, an image reproducing unit 57, a connection detecting means 58 and 
20 a control central processing unit (CPU) 60. The circuits are connected to one 
another through a bus 62. 

As is the case with the first image-capturing unit 12, the second image- 
capturing unit 14 comprises the taking lens 28, an imaging circuit 64, a lens 
drive unit 66 and a memory 66. The second image-capturing unit 14 further 
25 comprises a gain adjustment circuit 70 for adjusting the gain of an image signal, 
and a display position adjusting device 72 for adjusting the position of the image 
captured by the two imaging systems. 

Each of the imaging circuit 50 and 64 includes the CCD, a CDS circuit, a 
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gain adjustment circuit, an A/D converter, etc. An image of a subject is formed 
on the light receiving surface of the CCD through the taking lenses 16 or 28, and 
the CCD photoelectrically converts the image, which is sequentially read as 
video signals. The CDS circuit sample-holds the video signals read from the 
5 CCD on a pixel-by-pixel basis, and a gain control amplifier amplifies the video 
signals. Then, the A/D converter converts the video signals into dot-sequential 
RGB digital signals. 

The automatic control data obtaining unit 53 includes an automatic 
exposure (AE) integration circuit, an automatic white balance (AWB) gain 
plO determining circuit, and an autofocus (AF) value determining circuit. The 
jj automatic control data obtaining unit 53 determines a photometry value (AE 

Ifl value) in accordance with the image output signals (RGB digital signals) of one 

frame, which are inputted from the imaging circuit 50. The automatic control 
^ data obtaining unit 53 determines the levels of the RGB signals, and calculates a 

jjl5 gain value (AWB value) in such a way as to equalize the levels of the RGB 
y signals. The automatic control data obtaining unit 53 also determines a focus 

evaluation value indicating the sharpness of the subject's image in accordance 
with the image signals from the imaging circuit 50, and determines a focus 
position (AF value) with the focus evaluation value. The AE value, the AWB 
20 value and the AF value are sent to the control CPU 60, and they are used for 
controlling the AE, the AWB and the AF. 

The control CPU 60 supervises the circuits, and controls the circuits in 
accordance with a variety of signals inputted from the control parts such as the 
shutter release button 20 and the mode dial 42. More specifically, the control 
25 CPU 60 controls the exposure by setting a diaphragm and the electronic shutter 
values of the CCD of the imaging system in accordance with the AE value 
informed from the automatic control data obtaining unit 53. The control CPU 
60 sets the white balance by controlling the gain control amplifier in accordance 
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with the AWB value informed from the automatic control data obtaining unit 53. 
The control CPU 60 also controls the lens drive unit 52 in accordance with the 
AF value determined by the automatic control data obtaining unit 53 to thereby 
set the focusing position of the taking lens 16. 
5 The control CPU 60 is also used as an image processing CPU, which 

processes the image signals outputted from the imaging circuit 50 in a processing 
area of the memory 56. For example, the control CPU 60 generates luminance 
(Y) signals and color difference (C) signals and expands/compresses the image 
data. 

qIO The image reproducing unit 57 decodes the image data processed 

jTj according to the image signals read from the imaging circuits 50 and 64; the 

\~ image data read from the external storage device 26; and so on. The image 

jj reproducing unit 57 supplies the decoded image data to the image display or the 

l=aa LCD 40. Thus, the image captured through the CCD is displayed on the screen 

!™ 15 of the LCD 40, and the image data stored in the external storage device 26 can be 
y reproduced. 

*g Before the control CPU 60 receives a release signal (an image-recording 

start signal) generated by pressing the shutter release button 20, etc., a preview 
image (a moving or intermittent image for confirmation, which is displayed 

20 before the image recording) is displayed on the LCD 40. Upon input of the 
image-recording start signal, the screen of the LCD 40 freezes. In response to 
the input of the image-recording start signal, the image signals read from the 
imaging circuits 50 and 64 are compressed as the need arises after a 
predetermined processing and are stored in the external storage device 26. The 

25 storage medium is not restricted to the detachable external storage device 26, but 
it may also be an internal memory built in the image-capturing units 12 or 14. 
The image-recording start signal may also be transmitted from the outside of the 
image-capturing apparatus 10 such as a remote control and external connection 
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equipment. On completion of the above-mentioned recording process, the 
freezing state of the screen of the LCD 40 is cancelled, and the moving image or 
the intermittent image is displayed again. 

The image data stored in the external storage device 26 can be read under 
the control of the control CPU 60. The read image data is expanded, and is 
outputted to the LCD 40 through the image reproducing unit 57. 

The first image-capturing unit 12 has the connection detecting means 58, 
which detects the connection with the second image-capturing unit 14 at a 
contact point of the joint part and transmits a detection signal to the control CPU 
60. 

The synchronous signal generating circuit 54 transmits timing signals to 
the imaging circuit 50, the automatic control data obtaining unit 53, the image 
processing circuits, and so on, and also transmits synchronous signals for the 
signal processing to the second image-capturing unit 14. 

The second image-capturing unit 14 controls the imaging circuit 64 and 
the lens drive unit 66 by a control CPU 74 in accordance with the AE, AWB and 
AF information obtained by the automatic control data obtaining unit 53 of the 
first image-capturing unit 12. The control CPU 74 controls the gain adjustment 
circuit 70 in such a way that the level of the video signal of the second image- 
capturing unit 14 is equal to the level of the video signal of the first image- 
capturing unit 12 in accordance with the information from the first image- 
capturing unit 12. It is possible to use the control CPU 60 of the first image- 
capturing unit 12 without providing the control CPU 74 of the second image- 
capturing unit 14. 

Alternatively, the second image-capturing unit 14 may also be provided 
with an automatic control data obtaining unit 75 so that the automatic control 
data obtaining unit 75 can determine the AE, AWB, and AF according to the 
image signals outputted from the imaging circuit 64. If the second image- 
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capturing unit 14 has the automatic control data obtaining unit 75, it is also 
possible to share the operation to obtain the automatic control data between the 
first and second image-capturing units 12 and 14. For example, the automatic 
control data obtaining unit 53 of the first image-capturing unit 12 determines the 
5 AE and the AWB, and the automatic control data obtaining unit 75 of the second 
image-capturing unit 14 determines the AF. 

The display position adjusting device 72 is a means for correcting 
discordance between the imaging area of the imaging system of the first image- 
capturing unit 12 and the imaging area of the imaging system of the second 
p 10 image-capturing unit 14. The display position adjusting device 72 changes the 

y output extraction area (position) of the CCD in the imaging circuit 64, and 

ill 

;^ adjusts the display position of the second image-capturing unit 14 (the output 

jt] extraction position of the CCD) so that the closest subject can overlap with each 

J ra other on the image obtained through the two optical systems directed to the same 

^15 subject. The second image-capturing unit 14 is provided with the means for 
^ correcting the discordance between two images for the reasons stated below. 

When the image-capturing optical system of the first image-capturing unit 12 
and the image-capturing optical system of the second image-capturing unit 14 
are united, it is difficult to completely make their images correspond to one 
20 another due to the error of the attachment position of each CCD, and so on. 

More specifically, while the image obtained by the imaging system of the 
first image-capturing unit 12 and the image obtained by the imaging system of 
the second image-capturing unit 14 are displayed to overlap each other on the 
LCD 40, the image extraction position (area) and the angle of the imaging 
25 system of the second image-capturing unit 14 are adjusted by operating the cross 
key 48. The amount adjusted by the display position adjusting device 72 is 
stored in the memory 56 (or the internal memory of the control CPU 60) so as to 
maintain the adjusted state. 
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The first image-capturing unit 12 and the second image-capturing unit 14 
may be provided with power sources 77 and 78, respectively. Alternatively, the 
power source 77 of the first image-capturing unit 12 can also be used to supply 
the second image-capturing unit 14 with the power without the power source 78. 
5 Fig. 3 shows an example in which the two image-capturing units 12 and 

14 are connected. As described above, there is no limitation on the number of 
units to be connected. In the image-capturing apparatus 10 composed of 
multiple image-capturing units, the second image-capturing unit 14 and the 
subsequent image-capturing units also record the images in synchronism with the 
0 10 release signal outputted from the first image-capturing unit 12. In the 
jrj continuous image-recording mode, the image record timing of each image- 

ry capturing unit is offset by a predetermined time from the image record timing of 

:^ the preceding image-capturing unit. The continuous image-capturing is 

^ performed with time lags between the units. 

•if 15 If a plurality of image-capturing units capture the image cooperatively, 

O the synchronous signals outputted from the synchronous signal generating circuit 

*S 54 drive the circuits of the other image-capturing units. Alternatively, the 

second and the subsequent image-capturing units may be provided with 
synchronous signal generating circuits 80 so that the synchronous signals from 
20 the first image-capturing unit 12 can synchronize the synchronous signal 
generating circuits 80 of the second and the subsequent image-capturing units. 

If zoom lenses are used for the taking lenses 16 and 28, the zoom control 
signals from the first image-capturing unit 12 are preferably supplied to the other 
image-capturing units to control zooming mechanisms so that the zooming 
25 magnifications of the image-capturing units 12 and 14 can be equal during the 
operation of a zoom control part (not shown) of the first image-capturing unit 12. 

If a plurality of image-capturing units are connected, the amount of 
image data obtained by one image-recording differs according to the number of 
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the connected units. For this reason, it is desirable to provide a means for 
automatically changing the number of possible shots, which is shown to the 
operator, in accordance with the number of connected image-capturing units and 
the available capacity of the memory in the external storage device 26. 

Fig. 4 shows another embodiment of the image-capturing apparatus 10 in 
Fig. 1. As shown in Fig. 4, it is preferable to rotatably support a lens part (an 
imaging part) 82 of the second image-capturing unit 14 horizontally (and 
vertically as the need arises) and provide a means (equivalent to an optical axis 
angle changing means) for automatically setting the rotational angle of the lens 
part 82 according to the view angle of the lens 28. In this embodiment, the 
image processing means inside the camera or the image processing means 
outside the camera combines the images captured by the first and second image- 
capturing units 12 and 14 to thereby obtain a panoramic image. 

Preferably, the lens part 82 of the second image-capturing unit 14 is 
slidable horizontally, and there is provided a means (equivalent to a lens interval 
changing means) for setting the interval between the lenses 16 and 18 of the first 
and second image -capturing units 12 and 14. 

As described with reference to Fig. 1, the joint holes 36 and the slot 34 
are formed at the side of the second image-capturing unit 14 so that a third 
image-capturing unit 84 can be connected to the second image-capturing unit 14 
as shown in Fig. 5. Two joint holes 85 and a slot 86, which are the same as the 
joint holes 36 and the slot 34, are formed in the third image-capturing unit 34 so 
that it can be connected to a fourth image-capturing unit (not shown). There is 
no limitation on the number of image-capturing units to be connected. 

As shown in Fig. 6, it is also possible to connect an electronic flash unit 
88, which does not include any imaging means, instead of the image-capturing 
unit including the imaging means. The electronic flash unit 88 has a light 
emitting part 89, two joints 90 and a connector 91, and the electronic flash unit 
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88 can be connected to the second image-capturing unit 14 or the first image- 
capturing unit 12. Two joint holes 92 and a slot 93, which are the same as the 
joint holes 36 and the slot 34, are formed in the electronic flash unit 88 so that it 
can be further connected to another unit. According to this structure, it is 
possible to omit the electronic flash 18 in the first image-capturing unit 12, and 
connect the electronic flash unit 88 as the need arises or provide an electronic 
flash in the second and the subsequent image-capturing units. 

A description will now be given of the operation of the above-described 
image-capturing apparatus. 

TABLE 1 shows a list of modes in the image-capturing apparatus 
according to the present embodiment. 
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TABLE 1 



Mode 


Operation 


Single unit 


Normal image-capturing 


Multiple 
units 


Three 
dimensional 


A plurality of image-capturing units capture images at the same 
time to obtain a plurality of images from different viewpoints. 


Panorama 


The first and second image-capturing units capture images at the 
same time with the optical axis of the second image-capturing 
unit being inclined, thereby joining two images. 


Pan-focus 


A plurality of image-capturing units capture images at the same 
time at different focuses to compose an image with a broad 
focusing area. 


Dynamic range 
expansion 


A plurality of image-capturing units captures images at the same 
time under different exposure conditions to compose an image 
with a broad dynamic range. 


Special effects 
(extract depth 
information) 


Depth information is extracted from images that are captured at 
ine same lime oy a piuraiiiy 01 image-capturing units, ana image 
processing such as gradation is performed according to the depth. 


Multi-zooming 


A plurality of image-capturing units (lenses) capture images at the 
same time with different focal lengths (view angles). (A main 
subject is captured at a high resolution.) 


Continuous 
image-capturing 


A plurality of image-capturing units are driven at preset time 
intervals to continuously capture images. 


Recording 


File merging 


A sequence of related files are recorded as one image file. 


Separate file 


Related files are separately recorded, and related file names are 
given to the related files. 


Display 


Single 


A piece of image file data is displayed. 


Multiple 


Multiple pieces of image file data are displayed side by side. 


Overlap 


A plurality of overlapping semitransparent images are displayed. 
The image position is adjusted. 


Parallax barrier 


A parallax barrier is formed on an image display layer to display a 
three-dimensional image. 


Flashing 


Single flashing 


Only one flash lamp flashes. 


Simultaneous 
flashing 


A plurality of flash lamps flash simultaneously. 
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A description will be given of the functions of the image-capturing 
apparatus 10 with reference to TABLE 1. 

The first image-capturing unit 12 can be separated from the second 
image-capturing unit so that it can be used as a normal camera. In this case, the 
external storage device 26 is mounted in the slot 22, and the captured image data 
is stored in the external storage device 26. 

If the first image-capturing unit 12 is connected to one or more of image- 
capturing units such as the second image-capturing unit 14, the image-capturing 
apparatus 10 can be used in a variety of modes such as a three dimensional mode 
and a panoramic mode. In the three dimensional mode, two image-capturing 
units capture a right-eye image and a left-eye image at the same time to thereby 
obtain two images from different view points. 

In the panoramic mode, the optical axis of the second image-capturing 
unit 14 is inclined to the outside with respect to the optical axis of the first 
image-capturing unit 12, and the first image-capturing unit 12 and the second 
image-capturing unit 14 capture two images at the same time. The two images 
are processed and joined to thereby obtain a panoramic image, which is long in 
the landscape orientation. 

In the pan-focus mode, a plurality of image-capturing units capture 
images at different focus positions, and the focused areas of the images are 
combined to obtain an image, which is focussed over the whole area of the image. 
In the dynamic range expansion mode, a plurality of image-capturing units 
capture images at the same time under different exposure conditions, and the 
data on the images are combined to compose one image with a broad dynamic 
range. In the special effect mode, the depth distribution information is 
extracted from images, which are captured at the same time by a plurality of 
image-capturing units. According to the depth values, the special effects such 
as the blurring are performed for an area (e.g., the background area), which is not 
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at a specific distance, in order to emphasize the main subject. 

In the multi-zoom mode, a plurality of image-capturing units (lenses) 
captures images at the same time with different focal lengths (view angles) 
thereof. In this mode, the main subject is imaged at a high magnification 
5 (telescopically), and the image data of the images are connected to one another 
so that the main subject can be enlarged and displayed with a high image quality 
at the reproduction. The image processing method in the pan-focus mode, the 
dynamic range expansion mode, the special effect mode and the multi-zoom 
mode is not only applied to the image-capturing apparatus 10 but it may also be 
„ 10 applied in a variety of image processing techniques which process multiple 
jjj pieces of image data. In the continuous image-capturing mode, a plurality of 

1% image-capturing units are driven one-by-one at predetermined time intervals as 

+: described previously. 

! ™ The image data obtained in each image-capturing mode is recorded in 

2 15 one of the following two modes: the file merging mode and the separate file 
□ mode. In the file merging mode, a sequence of related files (image data files), 

y3 which are obtained at the same time or continuously by a plurality of image- 

capturing units, is recorded as one image file. 

In the separate file mode, the related files obtained by the image- 
20 capturing units are recorded separately, and related file names are automatically 
given to the related files. For example, "L" is added to a name of a data file for 
left-eye images, and "R" is added to a name of a data file for right-eye images. 

Preferably, the file names that are given automatically in the file merging 
mode, and the file names that are given automatically in the separate file mode, 
25 belong to different types so that they can be distinguished at a first glance. The 
control CPU 60 manages the files. 

To reproduce and display the image, it is possible to select one of the 
following four modes: the single mode, the multi-mode, the overlap mode and 
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the parallax barrier mode. In the single mode, a piece of image file data is 
displayed on the screen of the LCD 40. In the multi-mode, a plurality of image 
files are arranged on the screen of the LCD 40. In the overlap mode, a plurality 
of semi-transparent images are displayed to overlap each other on the screen of 
5 the LCD 40. The operator can adjust the positions of the images by the display 
position adjusting device 72 while looking at the overlapping images. 

In the parallax barrier mode, the parallax barrier is formed on the parallax 
barrier display layer of the LCD 40. And the image pattern, in which the strip- 
shaped image fragments of the left-eye images and the right-eye images are 

10 alternately arranged in conformity with the pitch of the parallax barrier, is 
displayed to display three-dimensional images. 

The flash lamps flash in the single flashing mode or the simultaneous 
flashing mode. Only one flash lamp flashes in the single flashing mode, 
whereas a plurality of flash lamps flash in the simultaneous flashing mode. 

15 In addition to the modes shown in Fig. 7, the image-capturing apparatus 

10 has functions as described below. 

It is possible to add a means for prohibiting the image-capturing or 
recording of any image-capturing unit to selectively use desired image-capturing 
units. In this case, the power for the unused image-capturing is preferably shut 

20 off to prevent the waste of power. 

It is possible to provide a file management means for joining multiple 
pieces of image data, which are captured with time lags in the single lens mode, 
to thereby obtain one image file, or the multiple pieces of image data are 
separately stored in a plurality of image files with related file names. 

25 In the image-capturing apparatus 10 stated above, a non-contact 

communication means (a wireless communication means), which uses 
electromagnetic waves such as infrared rays and radio waves in order to transmit 
the data between the first image-capturing unit 12 and the subsequent image- 
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capturing units. Consequently, the separated image-capturing units can capture 
the images at the same time. 

In these embodiments, the LCD is used as the image display, but an 
electroluminescence (EL) display, a light emitting diode (LED) display, a plasma 
display, or the like may also be used as the image display. 

In the above description, the apparatus (the electronic camera) converts 
the image light representing the subject into electric signals by the imaging 
device such as the CCD to thereby obtain the electronic image. The present 
invention may also be applied to an image-capturing apparatus, which uses a 
camera (a silver halide camera) for recording the image light on a photosensitive 
material such as photographic film. The present invention may be applied not 
only to the apparatus that captures still images but also to the apparatus that 
captures moving images. 

As set forth hereinabove, the image-capturing apparatus of the present 
invention modularizes the image-capturing units provided with the image- 
capturing optical systems. The first image-capturing unit, which is capable of 
functioning as the normal image-capturing apparatus, is connected to a plurality 
of image-capturing units as the need arises. Therefore, the image-capturing 
apparatus of the present invention is portable when it is used as the normal single 
lens camera. Moreover, the image-capturing units can easily be connected to 
the first image-capturing unit to expand the functions so that the image-capturing 
apparatus can be used as the multiple lens camera. This eliminates the waste in 
the structure of the image-capturing apparatus. 

In particular, a plurality of image-capturing units are synchronously 
driven to easily obtain a sequence of related images. It is therefore possible to 
easily obtain the three-dimensional image and the panoramic image. Moreover, 
it is possible to obtain the depth information from the multiple pieces of image 
data to perform the special effects such as the blurring of the background. 
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In addition, there is provided the means for correcting the discordance 
between the optical systems of the connected image-capturing units in order to 
obtain the high-quality three-dimensional image and panoramic image. 

It should be understood, however, that there is no intention to limit the 
invention to the specific forms disclosed, but on the contrary, the invention is to 
cover all modifications, alternate constructions and equivalents falling within the 
spirit and scope of the invention as expressed in the appended claims. 



